DOCUMENT RESUME 



ED 482 944 



SE 068 337 



TITLE 

INSTITUTION 

PUB DATE 
NOTE 

AVAILABLE FROM 



PUB TYPE 
EDRS’ PRICE 
DESCRIPTORS 



The Nation *s Report Card: Mathematics Highlights, 2003. 
National Center for Education Statistics (ED) , Washington, 
DC. 

2003-00-00 

37p. 

ED Pubs, P.O. Box 1398, Jessup, MD 20794. Tel: 877-4 -ED-PUBS 
(Toll Free); Fax: 301-470-1244; Web site: 
http ; //www. ed.gov/pubs . edpubs.. html; e-mail : 
edpubsOinet . ed . gov . 

Reports - Research (143) 

EDRS Price MF01/PC02 Plus Postage . 

Achievement; ^Mathematics ; Scores 



ABSTRACT 

This issue of The Nation's Report Card highlights mathematics 
in 2003. It includes sections on Average Scale Scores, Students Reaching NAEP 
Achievement Levels, Percentile Results, 2003 Assessment Design, State 
Results, Subgroup Results, Sample Mathematics Questions, Technical Notes, 
Additional Data Tables, and NAEP. on the Web. (AMT) 



er|c 



Reproductions supplied by EDRS are the best that can be made 
from the original document. 



PP6 Z8P Q3 Uc.^ % ^0 



hKLC 



gSNCES 



Nationnl Assessment of Educational Progress 



National Center for 
Education Statistics 



The Nation’s Report Card 



education 

Office of Educational Research and Improvement 

educational resources information 

. CENTER (ERIC) 

□ This document has been reproduced as 
received from the person or organization 
originating it. 

□ Minor changes have been made to 
improve reproduction quality. 




INSIDE THIS ISSUE: 



Average Scale Scores 



Si Students Reaching NAEP 
Achievement levels 



^ Percentile Results 

^ 2003 Assessment Design 

4 State Results 

H Subgroup Results 

Sample Mathematics 
Questions 

!L0 Technical Notes 
^ Additional Data Tables 
NAEP on the Web 



Important Indicator of 
Educational Process 



Since 1969 the National 
Assessment of Educa- 
tional Progress (NAEP) has 
been an ongoing nation- 
ally representative 
indicator of what American 
students know and can do 
in major academic 
subjects. 



Over the years, NAEP 
has measured students’ 
achievement In many 
subjects, including 
reading, mathematics, 
science, writing, U.S. 
history, geography, civics, 
and the arts. In 2003, 
NAEP conducted a 
national and state 
assessment in mathemat- 
ics at grades 4 and 8. 

NAEP is a project of the 
National Center for 
Education Statistics 
(NCES) within the Institute 
of Education Sciences of 
the U.S. Department of 
Education, and is over- 
seen by the National 
Assessment Governing 
Board (NAGB). 




Points of view or opinions stated in this 
document do not necessarily represent 
official OERI position or policy. 



Fourth- and Eighth-Graders’ Average 
Mathematics Scores Increase 



Average scores were higher in 2003 than in all the previous assessment years at both grades 
4 and 8. (Differences are discussed in the report only if they were found to be statistically 
significant.) 
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• Si gfiifi candy different from 2003. 



NOTE: Average mathematics scores are reported on a 0--500 scale. In addition to allowing for accommodations. The 
accommodations-permitted results (1996-2003) differ slightly from previous yeais’ results, and from previously 
reported results for 1996 and 2000. due to changes in sample weighting procedures. Significance tests were 
performed using unrounded nutnhers. 

SOURCE; U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, 
National Assessment of Educational Progress (NAEP), 1990. 1992. 1996. 2000, and 2003 Mathematics Assessments. 



ObuQ Ai(onui»tbt»nsaol^rmi!ted 
Accanum^tions psimitted 



How well did students perform in 2003? 



Grade 4 



Grade 8 



The figures to the right show that 32 percent of 
fourth-graders and 29 percent of eighth- 
graders performed at or above the Proficient 
level in 2003. The percentages of students 
performing at or above Basic in 2003 were 77 
percent at grade 4 and 68 percent at grade 8. 

NOTE: Detail may not sum to totals because of rounding. 



Advittctd 

Proficient 



4% 



5% 
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29% 


32% 




45% 


77% 



SOURCE: U.S. Department of Educabon, Institute of Education Sciences, 
National Center for Education Statistics, National Assessment of Educational 
Progress (NAEP). 2003 Mathematics Assessment. 
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Background Information 



Average test scores have a 
standard error — a range of up 
to a few points above or below 
the score — due to sampling 
error and measurement error. 
Statistical tests are used to 
determine whether the differ- 
ences between average scores 
are significant; therefore, not 
all apparent differences may be 
found to be statistically signifi- 
cant. All the differences 
discussed in this report were 
tested for statistical significance 
at the .05 level. 



obtaining an independently 
selected national sample. As a 
consequence, the size of the 
national sample increased, and 
smaller differences between 
years or between types of 
students were found to be 
statistically significant than 
would have been detected in 
previous assessments. In 
keeping with past practice, all 
statistically significant differ- 
ences are indicated in the 
cunent report. 



Beginning in 2002, the NAEP 
national sample was obtained 
by aggregating the samples 
from each state, rather than by 



The results presented in the 
figures and tables throughout 
this report distinguish between 
two different reporting samples 
that reflect a change in admin- 



istration procedures beginning 
in 1996. This change involved 
permitting students with 
disabilities or limited-English- 
proficicnt students to use 
certain accommodations (e.g, 
extended time, small group 
testing). Comparisons between 
results from 2003 and those 
from assessment years in which 
both types of administration 
procedures were used (1996 
and 2000) are discussed based 
on the results when accommo- 
dations were permitted, 
although significant differences 
in results when accommoda- 
tions were not permitted may 
be noted in the figures and 
tables. 
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Achievement 
Levels Provide 
Standards for 
Student 
Performance 

Achievement levels are 
performance standards 
set by NAGB to provide a 
context for interpreting 
student performance on 
NAEP. These perfor- 
mance standards, based 
on recommendations 
from broadly representa- 
tive panels of educators 
and members of the 
public, are used to 
report what students 
should know and be able 
to do at the Basic, Profi- 
cient, and Advanced levels 
of performance in each 
subject area and at each 
grade assessed 

Detailed descriptions of 
the NAEP mathematics 
achievement levels can 
be found on the NAGB 
web site (http:/ / 
www.nagb.org/ pubs/ 
pubs.html). 

The minimum scale 
scores for achievement 
levels are as follows: 



e\'aluation of NAEP, has 
determined that achieve- 
ment levels are to be 
used on a trial basis and 
should be interpreted 
and used with caution. 

However, both NCES 
and NAGB believe that 
these performance 
standards are useful for 
understanding trends in 
student achievement. 
NAEP achievement levels 
have been widely used by 
national and state officials. 



Gain Overall Since 1990 in Achievement- 
Level Performance 

As shown in the table and figure below, the percentages of fourth- and eighth-graders at 
or above Basic, at or above Proficient, and at Advanced were all higher in 2003 than in 
1990. There were also recent increases from 2000 to 2003 in the percentages of fourth- 
graders at or above Basic <iv\d Proficient znd at Advanced, and in the percentages of 
eighth-graders at or above Basic 2S\6. Proficient 

Percentages of students, by mathematics achievement level, grades 4 and 8: 1990-2003 



Accommodations not permitted 



Accommodations permitted 



Accommodations not permitted 



Accommodations permitted 







At or above 


At or above 






Below Basic 


Basic 


Proficient 


AtArfvanced 


1990 


50* 


50* 


13 * 


1 * 


1992 


41 * 


59 * 


18* 


2 * 


1996 


36* 


64 * 


21 * 


2 * 


2000 


31 * 


69 * 


26 * 


3* 


1996 


37* 


63* 


21 * 


2 * 


2000 


35* 


65* 


24 * 


3* 


2003 


23 


77 


32 


4 


1990 


48* 


52 * 


15* 


2 * 


1992 


42 * 


58* 


21 * 


3* 


1996 


38* 


62 * 


24 * 


4 * 


2000 


34* 


66* 


27 


5 


1996 


39 * 


61 * 


23 * 


4 * 


2000 


37* 


63* 


26 * 


5 


2003 


32 


68 


29 


5 



*Signiflcantly different from 2003. 

NOTE: Oetall may not sum to totals because of rounding. In addition to allowing for accommodations, the accommodations-permitted results (1996-2003) differ 
slightly from previous years* results, and from previously reported results for 1996 and 2000, due to changes in sample weighting procedures. Significance tests were 
performed using unrounded numbers. 

SOURCE: ua Oepartment of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Process (NAEP), 
1990, 1992, 1996, 2000, and 2003 MathemetJcs Assessments. 



Percentages of students at or above Basic and Proficient in mathematics, grades 4 and 8: 
1990-2003 

M 





Grade 


Grade 


10 






4 


8 


10 




Basic 


214 


262 


10 




Proficient 


249 


299 


10_ 




Advanced 


282 


333 


4 Q_ . 




As provided by law, NCES, 


10_. . 




upon review of a con- 


_21 




gressionally mandated 








Accommodattons not ponnittod 
% at or above fias/c 
% et or above Proticlent 



Accommodations permitted 
. % at Or above Basic 
^ % at or above Pro/icienf 



*90 *92 *96 *00 *98 TO ID 

Accommodations Accommodations 
not permitted permitted 

Grade 4 



*90 *92 “96 TO T8 TO '03 
Accommodations Accommodations 
not permitted permitted 

Grade 8 



*SlgnificentJy different from 2003. 

NOTE; In addition to allowing for accommodations, the accommodations-permitted results (1996-2003) differ slightly from previous years' results, and from 
previously reported results for 1996 and 2000, due to changes In sample vrolghtlng procedures. Significance tests were performed using unrounded numbers. 
SOURCE: U.S. Oepartment of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress 
(NAEP), 1990, 1992, 1996, 2000, and 2003 Mathematics Assessments. 



Achievement Levels 



Basic: This level denotes partial masteiy of prerequisite knowledge and skills that are 
fundamental for proficient work at each gi*ade. 

Proficient: This level represents solid academic performance for each grade assessed. 
Students reaching this level have demonstrated competency over challenging subject 
matter, including subject-matter knowledge, application of such knowledge to real-world 
situations, and analytical skills appropriate to the subject matter. 

Advanced: This level signifies superior performance. 

, 0 3 












Improvement Seen Among Lower-, Middle-, and Higher- 
Performing Students 



Looking at changes in 
scores for students at lower-, 
middle-, and higher-perfor- 
mance levels gives a more 
complete picture of student 
progress. An examination of 
scores at different percen- 
tiles on the 0-500 math- 
ematics scale at each grade 
indicates whether or not the 



changes seen in the national 
average score results are 
reflected in the performance 
of lower-, middle-, and 
higher-performing students. 

The percentile indicates the 
percentage of students whose 
scores fell below a particular 
score. For example, 25 



percent of assessed students’ 
scores fell below the 25th 
percentile score and 75 
percent fell below the 75th 
percentile score. 

At both grades 4 and 8, 
scores at the 10th, 25th, 

50th, 75th, and 90th percen- 
tiles were higher in 2003 



than in any of the previous 
assessment years. 

At grade 4, gains detected 
between 2000 and 2003 
ranged from approximately 
5 scale score points for 
students performing at the 
90th percentile to 13 points 
for students at the 10th 
percentile. 

At grade 8, increases since 
2000 ranged from approxi- 
mately 3 scale score points 
at the 90th percentile to 7 
points at the 10th percentile. 



0“»0 A((ommodafians not permitted 
Accommodations permitted 

•Significantly different from 2003. 

NOTE: In addition to allowing for accommodations, 
the accommodations-permitted results (1996-2003) 
differ slighdy from previous years’ results, and from 
previously reported results for 1996 and 2000, due 
to changes in sample weighting procedures. 
Significance tests were performed using unrounded 
numbers. 

SOURCE; U.S. Department of Education, Institute of 
Education Sciences, National Center for Education 
Statistics, National Assessment of Educational 
Progress (NAEP), 1990, 1992, 1996, 2000, and 
2003 Mathematics Assessments. 



Mathematics scale score percentiles, grades 4 and 8: 1990-2003 



Grade 4 




Percentiles 

y 



Grade 8 



90th 

75th 

50th 

25th 

10th 




Percentiles 

y 



90th 

75th 



279 50th 



NAEP 2003 Mathematics Assessment Design 



Assessment Framework 

The NAEP mathematics 
framework, which defines 
file content for the 1990- 
2003 assessments, was 
developed through a 
comprehensive national 
consultative pi’ocess and 
adopted by NAGB. 

The mathematics frame- 
work calls for the assess- 
ment to include ques- 
tions based on five matli- 
ematics content areas: 1) 
number sense, proper- 
ties, and operations; 2) 
measurement; 3) geom- 
etry and spatial sense; 4) 
data analysis, statistics, 
and probability; and 5) 
algebra and functions. 

In addition, the frame- 
work specifies that each 
question measure one of 
three mathematical 
abilities. The three 



mathematical abilities 
specified by the framework 
are 1) conceptual under- 
standing, 2) procedural 
knowledge, and 3) problem 
solving. 

The sample questions on 
pages 16-19 illustrate how 
the assessment was devel- 
oped to measure tlie 
content areas and math- 
ematical abilities. Each 
student answered approxi- 
mately 45 questions in 50 
minutes. 

The complete framework is 
available on tlie NAGB web 
site (http://www.nagb.org/ 
pubs/pubs.html) . 

Student Samples 

Results from the 2003 
mathematics assessment are 
reported for the nation and 
states at grades 4 and 8. 

The national results are 
based on a representative 



sample of students in both 
public schools and 
nonpublic schools, while the 
state results are based only 
on public-school students. 

Accommodations 

It is NAEP’s intent to assess 
all selected stitdents from 
the target population. 

Before 1996, no testing 
accommodations were 
provided to students with 
disabilities and limited- 
English-proficient students 
who participated in the 
NAEP matliematics assess- 
ments. In 1996 (national 
only) and 2000 (national 
and state) , NAEP was ad- 
ministered to two reporting 
samples — *"accommodations 
not permitted” and “accom- 
modations permitted.” 
Beginning in 2003, the 
NAEP matliematics assess- 
ment has adopted the new 



“accommodations-permit- 
ted” procedure as its only 
administration procedure, 
and thus again had only 
one reporting sample as 
in mathematics asses.s- 
ment years prior to 1996. 

Because the representa- 
tiveness of samples is 
ultimately a validity issue, 
NCES has commissioned 
studies of the impact of 
assessment accommoda- 
tions on overall scores. 
One paper that explores 
the impact of two possible 
scenarios on NAEP is 
available on the NAEP 
web site (http:// 
www.nces.ed.gov/ 
nation sreportcard/pdf/ 
main2002/statmeth.pdf) , 



The Nation ’s Report Card 



Most Participating States and Jurisdictions Show Gains at 
Grades 4 and 8 



In addition to national 
results, the 2003 mathemat- 
ics assessment collected 
performance data for 
fourth- and eighth-graders 
who attended public schools 
in 50 states and 3 other 
jurisdictions that participated. 



state Average Score 
Results 

Tables 1 and 2 present 
average mathematics score 
results for fourth- and 
eighth-graders respectively. 



Among the 43 states and 
jurisdictions that partici- 
pated in both the 2000 and 
2003 fourth-grade assess- 
ments, all showed increases 
in average scores. Similarly, 



all 42 of the states and 
Jurisdictions that partici- 
pated in the 1992 and 2003 
assessments showed in- 
creases in average scores. 



Table 1. Average mathematics scale scores, grade 4 public schools: By state, 1992>2003 



Accommodations 
not permitted 



Accommodations 

permitted 





1992 


1996 


2000 


2000 


2003 


Nation (public) ^ 


219* 


222 * 


226 * 


224 * 


234 


Alabama 


CO 

o 

CN 


212 *-** 


218 *-** 


217 *•** 


223 


Alaska 


- 


224 *-** 


- 




233 


Arizona 


215*-** 


218 *■** 


219 *-** 


219 *-** 


229 


Arkansas 


210*-** 


216 *■** 


217*-** 


216 ♦•** 


229 


California 


208 *-** 


209 *-** 


214 *-** 


213 ♦•** 


227 


Colorado 


221 *•** 


226 *■** 




_ 


235 


Connecticut 


227 *■** 


232 *-** 


234 *-** 


234 *-** 


241 


Delaware 


218*'** 


215*-** 


- 


- 


236 


Florida 


214 *•** 


216 *-** 


- 


- 


234 


Georgia 


216*'** 


215 *-** 


220*-** 


219 *-** 


230 


Hawaii 


214*'** 


215*-** 


216 *■** 


216*-** 


227 


Idaho 


222*.** 


- 


227 *•** 


224 ♦•** 


235 


Illinois 


- 


- 


225*-** 


223 *'** 


233 


Indiana 


221 *•** 


229 *-** 


234 *-** 


233 *-** 


238 


Iowa 


230 *-** 


229 *-** 


233 *-** 


231 *-** 


238 


Kansas 


_ 


- 


232 *-** 


232 *-** 


242 


Kentucky 


215*'** 


220*-** 


221 *-** 


219 *-** 


229 


Louisiana 


204*-** 


209 *-** 


218*-** 


218*-** 


226 


Maine 


232*.** 


232 *-** 


231 *'** 


230*-** 


238 


Maryland 


217*.** 


221 *-** 


222 *-** 


222 *-** 


233 


Massachusetts 


227 *** 


229 *-** 


235*-** 


233 


242 


Michigan 


220*'** 


226 *-** 


231 *'** 


229 *-*• 


236 


Minnesota 


228*'** 


232 *■** 


235*-** 


234 *-** 


242 


Mississippi 


202 *'** 


208 *-** 


211 *-** 


211 *-** 


223 


Missouri 


222 *'** 


225 *-** 


229 *■** 


228*-** 


235 


Montana 


- 


228 *-** 


230 *■** 


228*-** 


236 


Nebraska 


225*-** 


228 *-** 


226 *-** 


225 *-** 


236 


Nevada 


- 


218 *-** 


220*'** 


220*-** 


228 


New Hampshire 


230*-** 


- 


- 


- 


243 


New Jersey 


227 *•** 


227 *-** 


- 


- 


239 


New Mexico 


213*-** 


214 *-** 


214 *-** 


213 *-** 


223 


New York 


218 *■** 


223 *•** 


227 *-** 


225 *-** 


236 


North Carolina 


213*-** 


224 *-** 


232 *-** 


230 *•** 


242 


North Dakota 


229 *■** 


231 *■** 


231 *'** 


230 *-•* 


238 


Ohio 


219 *■** 


- 


231 *-•• 


230 *-•* 


238 


Oklahoma 


to 

to 

o 


- 


225*-** 


224 *-** 


229 


Oregon 


- 


223*.** 


227 *-** 


224 *•** 


236 


Pennsylvania 


224*-** 


226 *-** 


- 


- 


236 


Rhode Island 


215*-** 


220*-** 


225 *-** 


224 *-** 


230 


South Carolina 


212*.** 


213 *'** 


220 *-** 


220 *•** 


236 


South Dakota 


- 


_ 


_ 


_ 


237 


Tennessee 


211 *•** 


219 *-** 


220 *•** 


220*-** 


228 


Texas 


218*-** 


229 *-** 


233 •-•* 


231 *-** 


237 


Utah 


224*-** 


227 *-** 


227 *•** 


227 *'** 


235 


Vermont 


- 


225 *-** 


232 *•** 


232 *-** 


242 


Vir^nia 


221 *-** 


223*.** 


230 *-** 


230 *•** 


239 


Washington 


- 


225 *-** 


- 


- 


238 


West Virginia 


215*-** 


223 *-** 


225 *-** 


223*.** 


231 


Wisconsin 


229 *-** 


231 *•** 


- 


- 


237 


Wyoming 


225*-** 


223*.** 


229 *•** 


229 *•** 


241 


Other jurisdictions 


District of Columbia 


193*-** 


187*-** 


193*'** 


192 *•** 


205 


DDESS^ 


- 


224 *-** 


228*-** 


228*-** 


237 


DoDDS^ 


- 


223*.** 


228*-** 


226 *•** 


237 




-Not available. 

•Significantly different from 2003 when only 
one jurisdiction or the nation is being 
examined. 

• • Significantly different from 2003 when using a 
multiple-comparison procedure based on all 
jurisdictions that participated in both years. 

^National results for assessments priorto 2003 
are based on the national sample, not on 
aggregated state samples. 

^Department of Defense Domestic Dependent 
Elementary and Secondary Schools. 

^Department of Defense Dependents Schools 
(Overseas). 

NOTE: State-level data were not collected in 
1990. Comparative performance results may 
be affected by changes in exclusion rates for 
students with disabilities and limited -English- 
proficient students in the NAEP samples. In 
addition to allowing for accommodations, the 
accommodatlons-permitted results for 
national public schools (2000 and 2003) 
differ slightly from previous years' results, and 
from previously reported results for 2000. due 
to changes in sample wei^ting procedures. 
Significance tests were performed using 
unrounded numbers. 

SOURCE: U.S. Department of Education. 
Institute of Education Sciences. National 
Center for Education Statistics. National 
Assessment of Educational Progress (NAEP), 
1992. 1996, 2000, and 2003 Mathematics 
Assessments. 
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